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I, Yoshihisa Nagashima, hereby declare and state as follows: 

1 . I am a citizen of Japan. 

2. I am the inventor and applicant of the invention entitled "MOBILE 
COMMUNICATIONS TERMINAL, VOICE RECOGNITION METHOD FOR SAME, AND 
RECORD MEDIUM STORING PROGRAM FOR VOICE RECOGNITION", disclosed and 
claimed in U.S. Patent Application No. 10/015,881, filed December 17, 2001. 

3. At the time I invented the present invention, I was employed by NEC 
CORPORATION. 

4. Prior to December 11, 2000, the U.S. filing date of U.S. Patent Publication No. 
2002/0072917, the Mobile Communications Terminal, Voice Recognition Method for Same, and 
Record Medium Storing Program for Voice Recognition invention as described above and 
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claimed in the above referenced application was conceived in Japan, and further, the invention 
was constructively reduced to practice with diligence from the period prior to December 11, 
2000 to the filing of the priority document on December 25, 2000, as evidenced by the 
following: 

5. Prior to December 11, 2000, having earlier conceived the idea of the Mobile 
Communications Terminal, Voice Recognition Method for Same, and Record Medium Storing 
Program for Voice Recognition as set forth in the specification of the above referenced 
application, the present invention was formally submitted to my employer NEC 
CORPORATION in the form of an Notification of Employee's Invention and Assignment with 
an invention report. The Notification of Employee's Invention and Assignment with the 
invention report, together with an English translation thereof, are attached as Exhibits "A" and 
"B", respectively. 

6. The attached Notification of Employee's Invention and Assignment completely 
discloses the present invention as set forth and claimed in the above referenced application. 

7. Prior to December 11, 2000, NEC CORPORATION sent a request to Maruyama 
Patent Office, of Tokyo, Japan, requesting preparation of a patent application based on the 
invention report submitted with the Notification of Employee's Invention and Assignment. 

8. In the ordinary course of business, Maruyama Patent Office prepared the patent 
application, as requested by NEC CORPORATION. A draft of the patent application was 
prepared on December 1 8, 2000 and reviewed by NEC CORPORATION on December 2 1 , 2000. 
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Subsequently, the patent application was filed in the Japanese Patent Office on December 25, 
2000 as JP 2000-393709, which is the priority document of the above referenced U.S. Patent 
Application. A record showing the dates of the preparation of the draft application, the review of 
the draft and the filing of the application is attached herewith as Exhibit "C". 

I declare further that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States 
Code, and that such willful false statements may jeopardize the validity of the application or any 
patent issuing thereon. 
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Notification of employee's invention • Alignment • Opinion 
(Application on NECs own) 



[Entry space for inventor] 



Provisional No. 



Reference No. 



12969431 



532-09437 



Title of the invention " ' ~ ~ 

mobus terminal with aspeech recognition function 



Ckmfirmation 



Done 



Company Code 
Employee^ 



0000 
0972729 



Inventor 



Name 



Yosbihisa 
Nagashima 



Tfelephon 



25-24042 
045(939)2316 



e-mail address 
FAX number 



nagasi-y@mcd.yh 
045(939)2343 



Company 

Current department 



^CCcarporatbii 

Mobile tarminal division 

multimedia ocrnxmunication 



Form of notification 


" 1 • « , _ development section 

• notmcanon by mvention report (embcKlimente, fewiixga, etc.) 
O notification by completed specification 
O "concurrent" 


Foreign application 


^ desired 
O ^ not desired 


Countries USCNGB 


National priority 


O voluntary 

O requested by intellectual 

property dept. 
# not desired 


Application No. of the prior invention 
Application date of the prior invention 

(Fill in by 8 figures in dominical year form) 
Reference No. of the prior invention 
r^otrequest 

CFffliabySfeuTBsindoininxa^ j 


Schedule for external 
publication or shipment 


O publication of products 
O publication of papers 

O Othpr 

• no external publication 


Product name 

Name of academic conference 
Expected date for publication 
(Fill in by 8 figures in dominical year form) 


□ shipment 


Ship-to 

Expected date for shipment 

(Fill in by S figures in dominical vmt fn™} 


Rested invention (if any) 


Application No. 
Application date 
Reference No. 

_Country if foreign application has been filed 


Type of invention 


# ordinary invention 

O business modal (method or structure) 



Assignment 

I assign the right to obtain a patent or a utility model to NEC Corporation based on the 
employee regulation of NEC Corporation. P Dasea on me 
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Invention report 
[Title] 

Mobile terminal with a speech recognition function 

[Features of the invention] 

This invention uses speech recognition techniques developed for 

sTaTof °7 a *°* ality ° f a ™ bile te ™i-l and provides a system where 
search of telephone numbers, mail addresses and the like are easily 
conducted without deteriorating a recognition rate. 

As shown in Fig. 1, voices of names or the like are inputted into a 

ZcronT* "f " n' * ™ r » devices 

(macrophone, externally connected devices, etc.) and are read out at a voice 

recognition section 2. Voice data recognized at the voice recognition section 

2 is compared I with voice patterns 51 and the most resembled voice pattern 

fought m the terminal. When the search of the voice pattern succeeds, a 

oem 0ry search processing section 3 seeks telephone directories 55, which 

"as registered in the terminal, with reference to a voice-data 

correspondence table. At this point, a button section 9, which possesses 

unctmns allocated beforehand, is operated, and one of tdephonenumb 

o2, mail addresses 53 and URLs 54 is called for from the telephone 

dxrectories 55. The result is displayed on a display section 4 

and w,i n V ° iCe Patt6rnS ^ re ^ 8t ^d per telephone directory 

and with a button operation, conducted is search for a telephone number, a 

Zi P a ™ a URL ' MUUiPle ° f d9ta 3X6 CaUed for based on ™ 

[Embodiment] 
[Structure of the embodiment] 

inventing refereDCe u Kg ' *' regarfing an Pediment of the present 

Z£2 1 ™ rching pr0CMS on a mot * « -~ * 

„„„ t A 7° iCe toput section 1 is a ™*iver, microphone or an externally 
connected votce »put device and convey, voice signals of a user to a voice 
reckon section 2. The voice recognition section 2 analyzes the voice 
data sent from the section 1 and compares the data with more than one 
vo.ee pattern 51, which has been registered in the terminal. 

A m , em ° ry Sear ° h processin 8 <*«'<"> 3 enables a search through 
telephone dtreetories 65. In the telephone directories 55, registered are 
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personal data, telephone numbers 52, mail addresses 53, URLs 54 and the 

A voice search processing section 5 stores a voice-data 
correspondence table in which the voice patterns 51 and the telephone 
directors correspond one to one. Further, the section 5 stores a call 
correspondence table, which is used when a button operation section 9 is 
operated to call for various kinds of data in the telephone directories 55 
such as telephone numbers 52, mail addresses 53, URLs 54. The result of 
he search of telephone directories 55 corresponding to voice patterns 51 
tins comparison having been conducted at the voice recognition section 2, is 
displayed on a display section 4 via the memory search processing section 

The button operation section 9 informs the voice search processing 
sectmn 5 of the ON or OFF state of a telephone button 92, a mail buZ ^ 

nlLT net ^ Utt ° n H ^ 3 ^ ° f the t6rminal the buttons are 
pushed down. The section 9 can also direct which kind of data is called for 

*f° nS ^ ^ aU0Cated t0 the butt ™ *s ^ng as the 
three kinds of button are independently operated. Furthermore, the voice 

Zhl Pr0CeS8i r g rf° n 5 ^ be iDf0rmed 0f the activa ^ of 
apphcations instead of operation of the section 9. 

Based on the search result, telephone and mail communication, and 
the access to the nternet are enabled via a communication control section 
6, a transmission/reception section 7 and an antenna 8. 

[Operation of the embodiment] 

embocZT, refe 1 nCe T Fi8S ' 1 * ^ Wh ° le ° perati0n ° f the 

embodiment is explained in detail. 

call ^ UtterS 3 0ame ° f 8 PerSOn ' whom the user wish « *° »<*e a 
caU^into the voice input section 1. The uttered voice data is conveyed to the 

vo co recosm ,on section 2. The voice recognition section 2 analyzes the 

nattert I,". ""^T, * * mMe ^ ° ne ™<* » a " e ™ «• «» voice 
patterns 51 are ge„ eraUy etandard voke patten>8 for ^ 

UtUred IT" 9 ' CharSCter infomatioa <* "Satoh" etc. is registered. 
Uttered W ords or registered voice patterns 51 are not necessarily names 

wnf " * P " ° f Mme can als ° be used - a » editorial 
function .for vo.ce patterns is given, this change is easily realized. 

voice na^r ^ UtterBd V ° iCe ° ata d0S6ly ° r mateh os with the 

voice patterns 61 revered in the terminal, the voice-data correspondence 



FROM MRUYAMA PATENT ' j) 2005* 6fl IBM 20: 27/ ^0:24/^4801 05431 7 



P 4 



table 50 in Fig. 3 is referred to and the telephone directory 55 
corresponding to the voice pattern 51 is called for. The memory search 
processing section 3 calls for the telephone directory 55 and the display 
section 4 displays the result. Since each voice pattern 51 and each 
telephone directory 55 correspond one to one, a plurality of telephone 
directories are never called for. 

With reference to Fig. 2, a method of calling for the above various 
kinds of data is explained. In this embodiment, the voice patterns 51 are 
denned as names of the telephone directories 55. Telephone numbers 52 
mail addresses 53 and URLs 54 are registered as personal data to the 
telephone directories 55, which are searched through with reference to the 
voice-data correspondence table 50. 

Regarding the method of calling for the above various kinds of data 
one example where the telephone button 92 is pushed down at the button 
operation section 9 is explained. When the telephone button 92 is pushed 
down at the button operation section 9, at a time voice is inputted from the 
voice input section 1, only the telephone numbers 52 can be called for A 
user may utter "Satoh". Then the telephone directories 55 is searched for 
iSLM and the telephone number 52 "XXX-XXX-XXXX" is called for Other 
personal data such as the mail address 53 or the UTIL 54 cannot be reached 
It any telephone number 52 is not registered in the telephone directories 55 
the display section 4 displays the result accordingly. The case where the 
mail button 93 or the Internet button 94 is pushed down is equally treated 
Only the data, which belongs to the button's function, is called for The 
buttons' name and content are not limited to "telephone", "mail" or 
Internet", and the states of the buttons are not limited to "ON" and "OFF' 
as far as the buttons are operated independently. Further, the data called 
for is changed according to the state of activated applications instead of the 
button operation. For instance, only UKLs 54 may be called for when a 
browser are activated. Then distinctions are established and the button 
operation is no more required. 

The called data is displayed on the display section 4, and calling a 
telephone number, sending a mail, and connecting a URL become possible 
with the communication control section 6, the transmission/reception 
section 7, and the antenna 8 etc. 

[Effect of the invention] 

Firstly, the present invention can call for multiple kinds of data 
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based on one voice pattern. 

Combined with button operations, various kinds of data (telephone 
numbers, mail addresses, URLs etc.) are independently called for 
Consequently, the present invention reduces burden of ever diversifying 
mobile terminal's operations. 

Secondly, the present invention does not have to consolidate one-to- 
one relations between voice patterns and telephone numbers (or mail 
addresses) any more. In the present invention, a voice pattern and a 
telephone directory correspond one to one. 

As a result, the number of voice patterns is reduced and even if the 
amount of data increases, a speech recognition rate is not going down. 

[Other embodiments] 

Another embodiment is explained in detail with reference to 
drawings. 

In Fig. 4, only the internal structure of the voice search processing 
section 5 is different from the previous embodiment. Explanations for other 
structures and functions are omitted. 

Voice patterns of the voice search processing section 5 in this 
embodiment are divided into three tables according to their functions. 
Namely, there exist a table 512 of a voice pattern 1 to call for telephone 
numbers 52, a table 513 of a voice pattern 2 to call for mail addresses 53 
and a table 514 of a voice pattern 3 to call for URLs 54. The same voice 
pattern must not be registered in the same table but can be registered in 
diiferent tables. 

As can be seen from a voice-data correspondence table in 50, by 
operating the button operation section 9, each table of voice patterns 512 
513 or 514 are selected, and telephone numbers 52, mail addresses 53, and 
UKliS 54 are correspondingly called for. 

For example, an explanation is given to an operation of a mail 
button 93 with reference to Fig. 5. When the mail button 93 is pushed, the 
table 513 of the voice pattern 2 becomes active. If a user utters "Suzuki" to 
the voice input section 1, a mail address "suzuki@yy.ne.jp" is called for. 

The button operations may be replaced with states of activated 
applications to select one of voice patterns 512, 513 and 514. 

In the previous embodiment, telephone directories are dealt as one 
unit and called for, in the case where the called telephone directory lacks 
part of personal data, as in the case of "Suzuki" in Fig. 3 which lacks URL 
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information, user cannot obtain data. In this embodiment, however, voice 
patterns are divided according to kinds of data and thus once a voice 
pattern is identified, the corresponding data is always obtained. As a result 
more data can become a subject of the voice search. Further, the number of 
registered voice patterns exceed that of the previous embodiment since the 
voice patterns are managed by multiple tables of voice patterns 
Furthermore, this embodiment inherits the effect of the previous 
embodiment. 

[Background of the invention] 

Recently a mobile terminal conducts a search for telephone 
numbers, notifying telephone numbers, calling for functions etc. using a 
speech recognition technique. For example, when recipient's name is 
uttered into a receiver or equivalent devices (microphones, externally 
connected devices etc.), the desired telephone directory or telephone 

reduced ^ ^ ***** ° f °P erations bv hands * 

Here a conventional technique is explained with reference to Fig 1 
Fig. 5 shows a block diagram of a conventional mobile terminal, which 
performs a telephone number search based on speech recognition. Voices of 
a name inputted through a voice input section 1 are read at a voice 
recognition section 2. The voice data read at the voice recognition section 2 
is compared with voice pattern 51 and the most resembled voice pattern 
registered in the terminal is looked for. When the voice pattern is found a 
memory search processing section 3 searches telephone numbers 52 with 
reference to a voice-data correspondence table 50 and the result is 
displayed on a display section 4. Then a user can telephone a recipient 
usmg the telephone number through a communication control section 6 a 
transmission/reception section 7 and an antenna 8. 

However, the conventional technique had problems as below. 

Firstly, as the number of voice patterns increases, the speech 
recognition rate becomes worse. 

The reason is that similar voice patterns tend to be wrongly selected 
on a high probability as voice patterns increase. Therefore, the number of 
voice patterns must be limited at some point. 

Secondly, since mobile terminals are used in various ways, not only 
making a call but also sending an email or accessing to the Internet the 
operations of the terminal should become easier 
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If mails or access to the Internet is consolidated on a similar voice 
pattern table as telephone numbers in order to solve the above problem 
more voice patterns are required. Consequently, as the first problem the 
speech recognition rate becomes worse, lb. sustain a certain level of speech 
recognition rate, the number of registered voice patterns must be reduced. 

Thirdly, one voice pattern cannot be associated with two or more 

words. 

If one voice pattern has multiple functions, these functions compete 
with each other. 

The present invention provides a speech recognition method for a 
mobile terminal to solve these problems. 

[Scope of protection sought] 

(1) A feature that various kinds of data are called for at a data search based 
on voice, with button operations or by detecting a state of activated 
applications. 

(2) A feature that a voice-data correspondence table is constructed in a way 
that one voice pattern corresponds to a plurality of kinds of data not as 
a conventional way of a one-to-one correspondence between voice and 
called data (cf. Fig. 3). 

(3) A feature that a voice-data correspondence table is divided into a 
plurality of tables depending on button operations or detection of states 
of activated applications, many voice patterns are possessed and data 
that is called for increases. 

[Formula for voluntary search before handing in a report] 

[Publication numbers or patent numbers likely to be relevant to the 
present invention] 

[Keywords for search] 

Keywords: 1 mobile phone: mobile information terminal: mobile 
communication terminal 

: 2 speech recognition: voice calling 
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